Multi‐modal fusion method for human action recognition based on IALC

نویسندگان

چکیده

In occlusion and interaction scenarios, human action recognition (HAR) accuracy is low. To address this issue, paper proposes a novel multi-modal fusion framework for HAR. framework, module called improved attention long short-term memory (IAL) proposed, which combines the SE-ResNet50 (ISE-ResNet50) with (LSTM). IAL can extract video sequence features skeleton of behaviour. improve performance HAR at high semantic level, obtained are fed into couple hidden Markov model (CHMM), IAL+CHMM method IALC developed based on probability graph model. test proposed method, experiments conducted HMDB51, UCF101, Kinetics 400k, ActivityNet datasets, 86.40%, 97.78%, 81.12%, 69.36% four respectively. The experimental results show that when environment complex, achieve more accurate target results.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Multimodal medical image fusion based on Yager’s intuitionistic fuzzy sets

The objective of image fusion for medical images is to combine multiple images obtained from various sources into a single image suitable for better diagnosis. Most of the state-of-the-art image fusing technique is based on nonfuzzy sets, and the fused image so obtained lags with complementary information. Intuitionistic fuzzy sets (IFS) are determined to be more suitable for civilian, and medi...

متن کامل

Action Recognition based on Subdivision-Fusion Model

This paper proposes a novel Subdivision-Fusion Model (SFM) to recognize human actions. In most action recognition tasks, overlapping feature distribution is a common problem leading to overfitting. In the subdivision stage of the proposed SFM, samples in each category are clustered. Then, such samples are grouped into multiple more concentrated subcategories. Boundaries for the subcategories ar...

متن کامل

Multimodal Biometrics Information Fusion for Efficient Recognition using Weighted Method

Biometrics do not provide unique identification. The matching process is probabilistic and is liable to measureable lapse error. A mistaken verfication or identification where the wrong person is matched against an enrolled user is termed a False Acceptance and the rate at which these occur is the False Acceptance Rate (FAR). Conversely, an error that occurs where a legitimate user fails to be ...

متن کامل

Multimodal Recognition Method based on Ear and Profile Face Feature Fusion

The performance of ear recognition is influenced by pose variation. For the similar position of ear and profile face, a multimodal recognition method is proposed based on the feature fusion of ear and profile face information. A model for ear and profile face feature fusion and recognition is built. The Log-Gabor features of ear and profile face are first extracted separately, and two features ...

متن کامل

An enhanced method for human action recognition

This paper presents a fast and simple method for human action recognition. The proposed technique relies on detecting interest points using SIFT (scale invariant feature transform) from each frame of the video. A fine-tuning step is used here to limit the number of interesting points according to the amount of details. Then the popular approach Bag of Video Words is applied with a new normaliza...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Iet Image Processing

سال: 2022

ISSN: ['1751-9659', '1751-9667']

DOI: https://doi.org/10.1049/ipr2.12640